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Authority under Article 35 and transmitted to the applicant according to Article 36. 

2. This REPORT consists of a total of 3 sheets, including this cover sheet. 

3. This report is also accompanied by ANNEXES, comprising: 
(sent to the applicant and to the International Bureau) a total of 8 sheets, as follows: 



□ 



sheets of the description, claims and/or drawings which have been amended and are the basis of this report 
and/or sheets containing rectifications authorized by this Authority (see Rule 70.16 and Section 607 of the 
Administrative Instructions). 

sheets which supersede earlier sheets, but which this Authority considers contain an amendment that goes 
beyond the disclosure in the international application as filed, as indicated in item 4 of Box No. I and the 
Supplemental Box. 

h PI (sent to the International Bureau only) a total of (indicate type and number of electronic carriers)) 

D * 1 — 1 7 containing a sequence listing and/or tables related thereto, in computer 

readable form only, as indicated in the Supplemental Box Relating to Sequence Listing (see Section 802 of the 
Administrative Instructions). 



4. This report contains indications relating to the following items: 

Basis of the report 
Priority 

Non-establishment of opinion with regard to novelty, inventive step and industrial applicability 
Lack of unity of invention 

Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 
Certain documents cited 
Certain defects in the international application 
| | Box No. VIII Certain observations on the international application 
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Box No. II 
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Box No. Ill 
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Box No. VI 
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Box No. Vn 
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Box No. VIU 
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21 April 2004(21.04.2004) 



Name and mailing address of the IPEA/JP 



Facsimile No. 



Date of completion of this report 

14 January 2005 (14.01 .2005) 



Authorized officer 
Telephone No. 



Form PCT/IPEA/409 (cover sheet) (January 2004) 




INTERNATIONAL PRELIMINARY REPORT ON PATENTABILITY 



InternatiSS^pplication No. 

PCT/JP2003/015824 



Box No. I Basis of the report 



1. With regard to the language, this report is based on the international application in the language in which it was filed, unless 
otherwise indicated under this item. 

| | This report is based on translations from the original language into the following language 

which is language of a translation furnished for the purpose of: 

| | international search (under Rules 12.3 and 23 . 1 (b)) 

| | publication of the international application (under Rule 12.4) 

| | international preliminary examination (under Rules 55.2 and/or 55.3) 



2 With regard to the elements of the international application, this report is based on (replacement sheets which have been 
furnished to the receiving Office in response to an invitation under Article 14 are referred to in this report as originally Jilea 
and are not annexed to this report) : 

Q The international application as originally filed/furnished 
><J the description: 

pages 1,2,6-66 , as originally filed/furnished 

pages* 

pages* 



the claims: 

pages 

pages* 

pages* 
pages* 



the drawings: 

pages 

pages* 

pages* 



3,3/1,4,5 



received by this Authority on 
received by this Authority on 



14 October 2004 (14.10.2004) 



1-35,37-41,43-59,61,63-65 



36,42,62,66 



, as originally filed/furnished 
, as amended (together with any statement) under Article 19 
received by this Authority on 14 October 2004 (14.10.2004) 
received by this Authority on 



1-68 



, as originally filed/furnished 



received by this Authority on 
received by this Authority on 



[ | a sequence listing and/or any related table(s) - see Supplemental Box Relating to Sequence Listing. 



3. 



The amendments have resulted in the cancellation of: 

| | the description, pages 

the claims, Nos. __ 



60 



[ | the drawings, sheets/figs 

| | the sequence listing (specify): 

| | any tabie(s) related to sequence listing (specify): 



Lfl This report has been established as if (some of) the amendments annexed to this report and listed below had not been 
made, since they have been considered to go beyond the disclosure as filed, as indicated in the Supplemental Box 
(Rule 70.2(c)). 

the description, pages 

the claims, Nos. . 



□ 
□ 

| | the drawings, sheets/figs 

[ | the sequence listing (specify): . 

| | any table(s) related to sequence listing (specify): . 



* If item 4 applies, some or all of those sheets may be marked "superseded " 
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Internatiq^^ftplication No. 

T/JP03/15824 



| Box No. V Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 



1. Statement 

Novelty (N) 



Inventive step (IS) 



Industrial applicability (IA) 



Claims 
Claims 

Claims 
Claims 

Claims 
Claims 



1-59, 61-66 



1-59, 61-66 



1-59, 61-66 



YES 
NO 

YES 
NO 

YES 
NO 



I 2. Citations and explanations (Rule 70.7) 

Idaims 1-59 and 61-66 

.document 1 [JP, 2002-324036, A (Sony Computer Entertainment Inc.), 08 November, 2002, Full text; 
Fig 7 & US, 2002/120701, Al & WO, 2002/065304, Al] fe a document indicating the general state of 
the art in the' relevant technical field; it describes a template selection part, a message sending part and 
a script execution part. Art for enabling a user to detect changeable portions of data referred to by a 
script included in a template and changing the changeable portion is neither described nor suggested in| 
lany of the documents cited in the ISR. 



Form PCT/ IPEA/409 (Box No. V) (January 2004) 



Translation of Annexes 
(Substitute Pages) 



data changing unit for changing the portion that can be changed, and a script and data 
outputting unit for outputting at least either the script or the changed data. 

A multimedia data processing device according to another aspect of the present 
invention is provided with a script implementing unit for reproducing data that is 
5 referred from a script that is included in a template in accordance with the script, a 

function selecting unit for selecting a function of the multimedia data processing device 
in accordance with the script that is included in the template, an action determining unit 
for determining which process is to be carried out on the data that is referred from the 
script by using the selected function in accordance with the script that isJnclilded in the 

10 template, an action implementing unit for implementing the determined process^ a data 
changing unit for changing the data that is referred from the script, and a script and data 
outputting unit for outputting at least either the script or the changed data. 

A multimedia data processing device according to still another aspect of the 
present invention is provided with a template list acquiring unit for acquiring a list of 

15 templates that have been formed so as to include scripts where a predetermined action 
that requires to be carried out by another device on the receiving side and time 
information for when the action is required are described , a template list displaying unit 
for displaying a list of templates, a template selecting unit for selecting one or more 
desired template from a list of displayed templates, and a message transmitting unit for 

20 transmitting the selected template to another device as a message. 

A multimedia data processing device according to yet another aspect of the 
present invention is provided with a template acquiring unit for acquiring a template that 
has been formed so as to include a script, a program acquiring unit for acquiring a 
program from a broadcasting station, a contents acquiring unit for acquiring internet 

25 contents which are provided via the internet, and a script implementing unit for 

reproducing at least one of data that is referred from the script, a program that has been 
acquired by the program acquiring unit, and internet contents that have been acquired by 
the contents acquiring unit in accordance with the script that is included in the template 
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in a position on the screen and according to timing which are designated by the script . 

A multimedia data processing program according to still yet another aspect of 
the present invention is a program for allowing a computer to carry out the process of a 
template that has been formed so as to include a script which allows the computer to 
5 carry out the script implementing step of reproducing data that is referred from a script 
that is included in the template in accordance with the script, the user changeable data 
determining step of determining a portion that can be changed by a user from among 
data that is referred from the script, the data changing step of changing the changeable 
portion by using a function of a multimedia data processing device, and the script and 

10 data outputting step of outputting at least one of the script and the changed data. 

A multimedia data processing program according to another aspect of the 
present invention is a program for allowing a computer to carry out the process of a 
template that has been formed so as to include a script which allows the computer to 
carry out the script implementing step of reproducing data that is referred from a script 

15 that is included in the template in accordance with the script, the terminal function 
selecting step of selecting a function of a multimedia data processing device in 
accordance with the script that is included in the template, the action determining step of 
determining which process is to be carried out for the data that is referred from the 
script by using the selected function, the action implementing step of implementing the 

20 . determined process, the data changing step of changing the data that is referred from the 
script, and the script and data outputting step of outputting at least one of the script and 
the changed data. 
(Deleted) 

A data structure for multimedia contents data according, to yet another aspect of 
25 the present invention is a data structure for multimedia contents data which is processed 
in a data processing device that includes a reproducing unit for reproducing media data 
and an inputting unit for receiving an input operation from the user, and which includes 
a reproduction describing unit for showing media data that is reproduced in the 

- 5 - 
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reproducing unit of the data processing device, an input operation describing unit for 
showing an input operation that is received by the inputting unit of the data processing 
device, and a process that corresponds to the input operation, and a schedule describing 
unit for managing time of effect of the media data that is reproduced in the reproducing 
5 unit of the data processing device and time of effect of the input operation that is 

received by the input unit, wherein the multimedia contents data is processed so that 
predetermined media data is reproduced in the reproducing unit of the data processing 
device at a predetermined time on the basis of the schedule describing unit, a 
predetermined input operation is received by the inputting unit of the data processing 
10 device at a predetermined time, and the data processing device carries out a process that 
corresponds to the predetermined input operation at the predetermined time on the basis 
of the input operation describing unit. 

Brief Description of the Drawings 
15 Fig. 1 is a diagram showing the configuration of a data communication system 

according to the present embodiment. 

Fig. 2 is a block diagram showing a concrete example of the hardware 
configuration of a cellular phone 1 which is a reproducing and editing device that is 
included in the data communication system. 

20 
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said script and data outputting unit outputs at least one of said script and said data 
changed to a memory device inside said multimedia data processing device. 

33. The multimedia data processing device according to claim 1 or 2, wherein 
said script and data outputting unit outputs at least one of said script and said data 
changed to another device via a network. 

34. The multimedia data processing device according to claim 33, which 
outputs at least one of said script and said data changed. 

35. The multimedia data processing device according to claim 33, wherein said 
script and data outputting unit outputs at least one of said script and said data changed 
to said other device by using MMS (Multimedia Messaging Service). 

36. (Amended) A multimedia data processing device, comprising: 

a template list acquiring unit (110) for acquiring a list of templates that have 
been formed so as to include scripts where a predetermined action that requires to be 
carried out by another device on the receiving side and time information for when said 
action is required are described ; 

a template list displaying unit (144) for displaying said list of templates; 

a template selecting unit (142) for selecting one or more desired template from 
said list of displayed templates; and 

a message transmitting unit (110) for transmitting said template selected to said 
another device as a message. 

37. The multimedia data processing device according to claim 36, wherein said 
script is characterized by including at least one of reference information to reproduced 
data, a method for reproducing said data, and action information for specifying the 
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function that is to be carried out in the terminal for reproducing said data. 

38. The multimedia data processing device according to claim 37, wherein said 
action information specifies at least one function from among a video or still image 
5 taking function, a function of acquiring text information inputted by a user, a sound 
recording function, a function of acquiring position information, and a function of 
acquiring data. 



39. The multimedia data processing device according to claim 36, further 
10 comprising a script implementing unit (13 1) for reproducing said data that is referred 

from a script in accordance with said script. 

40. The multimedia data processing device according to claim 36, further 
comprising a communication interlocutor function acquiring unit (110) for acquiring the 

15 function of a communication interlocutor apparatus, wherein 

said template list acquiring unit acquires a list of templates that can be 
implemented using said function that is included in said function acquired of said 
communication interlocutor apparatus. 



20 41 . The multimedia data processing device according to claim 36, further 

comprising a communication interlocutor function acquiring unit (110) for acquiring the 
function of a communication interlocutor apparatus, wherein 

said template list displaying unit displays a list of templates that can be 
implemented using said function that is included in said function acquired of said 

25 communication interlocutor apparatus. 



42. (Amended) A multimedia data processing device, comprising: 

a template acquiring unit (110) for acquiring a template that has been formed so 
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as to include a script; 

a program acquiring unit (110) for acquiring a program from a broadcasting 

station; 

a contents acquiring unit (110) for acquiring internet contents which are 
provided via the internet; and 

a script implementing unit (13 1) for reproducing at least one of data that is 
referred from said script, said program that has been acquired by said program acquiring 
unit, and said internet contents that have been acquired by said contents acquiring unit in 
accordance with said script that is included in said template in a position on the screen 
and according to timing which are designated by said script . 

43. The multimedia data processing device according to claim 42, wherein 
said template includes program list information, 

said multimedia data processing device further comprises a reproduction data 
selecting unit (142) for selecting one or more program or internet contents on the basis 
of said program list information, and 

said script implementing unit reproduces said program or said internet contents 



44. A multimedia data processing program for allowing a computer to carry 
out the process of a template that has been formed so as to include a script, which 
allows the computer to carry out: 

the script implementing step (SI 101) of reproducing data that is referred from 
said script that is included in said template in accordance with said script; 

the user changeable data determining step (SI 1 10) of determining a portion that 
can be changed by a user from among said data that is referred from said script; 

the data changing step (SI 205) of changing said portion changeable by using a 
function of a multimedia data processing device; and 



selected. 



-87- 



Translation of Annexes to IPRP 
(Substitute Pages) 



the script and data outputting step (SI 103) of outputting at least one of said 
script and said data changed. 

45. A multimedia data processing program for allowing a computer to carry 
out the process of a template that has been formed so as to include a script, which 
allows the computer to carry out: 

the script implementing step (SI 6) of reproducing data that is referred from said 
script that is included in said template in accordance with said script; 

the terminal function selecting step (SI 7) of selecting a function of a multimedia 
data processing device in accordance with said script that is included in said template; 

the action determining step (S81) of determining which process is to be carried 
out for said data that is referred from said script by using said function selected; 

the action implementing step (S82) of implementing said process determined; 

the data changing step (S85) of changing said data that is referred from said 
script; and 

the script and data outputting step (S25) of outputting at least one of said script 
and said data changed. 

46. The multimedia data processing program according to claim 45, wherein 
time restriction for determining an action that is carried out on said data that is referred 
from said script is described in said template, and said action implementing unit carries 
out said determined process in accordance with said time restriction. 

47. The multimedia data processing program according to claim 44 or 45, 
wherein transition information of the state of reproduction of media data is described in 
said template, and said transition of the state of reproduction of media data is managed 
in said script implementing step. 
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48. The multimedia data processing program according to claim 44 or 45, 
wherein transition information of the state of reproduction of media data is described in 
said template together with time restriction, and said transition of the state of 
reproduction of media data is chronologically managed in said script implementing step. 

5 

49. The multimedia data processing program according to claim 44 or 45, 
wherein 

transition information of the state of reproduction of media data is described in 
said template, and 

10 the multimedia data processing program further allows the computer to carry 

out: 

the thumbnail generating step (SI 6) of generating a thumbnail of media data that 
is included in said template; and 

the preview step (SI 8) of displaying said thumbnail generated on the basis of 
15 said transition information. 

50. The multimedia data processing program according to claim 44 or 45, 
which further allows the computer to carry out: 

the template acquiring step (SI 2) of acquiring said template that includes said 

20 script; 

the selecting step (SI 100) of selecting a desired template from said acquired 
template; and 

the data change confirming step (SI 100) of confirming said changing in said data. 

25 51 . The multimedia data processing program according to claim 44 or 45, 

which further allows the computer to carry out the restricting step (S 121) of restricting 
said changing in said data in accordance with said script. 
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10 



15 



20 



52. The multimedia data processing program according to claim 44 or 45, 
which further allows the computer to carry out: 

the sequence managing step (SI 401) of managing a sequence that is described in 
said script; and 

the changeable data proposing step (S1402) of proposing changeable data in 
response to said sequence. 

53. The multimedia data processing program according to claim 44 or 45, 
which further allows the computer to carry out: 

the sequence managing step (SI 401) of managing a sequence that is described in 
said script; and 

the operation guidance proposing step (S1402) of proposing an operation 
guidance for carrying out data change in response to said sequence. 

54. The multimedia data processing program according to claim 53, which 
further allows the computer to carry out the reproduction time controlling step (SI 5) of 
controlling the reproduction time of said data changed in accordance with a 
predetermined rule in said script implementing step in the case where an operation of 
said data change is carried out. 

55. The multimedia data processing program according to claim 44 or 45, 
which further allows the computer to carry out: 

the media time selecting step (SI 5) of determining and selecting a portion of said 
data that is referred from said script where implementation or termination can be carried 
out in said script implementing step; and 

said portion is paused when implementing said portion selected of said data in 
said script implementing step. 
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56. The multimedia data processing program according to claim 55, wherein 
said portion that is selected in said media time selecting step is a portion where 
changeable media data switches. 

57. The multimedia data processing program according to claim 56, which 
further allows the computer to carry out: 

the sequence change selecting step (SI 202) of determining a sequence changing 
point that is the closest in the future from this time in said script implementing step; and 

the reproduction of said data is skipped to "said sequence changing point 
determined next in said script implementing step. 

58. The multimedia data processing program according to claim 56, which 
further allows the computer to carry out: 

the sequence change selecting step (SI 202) of determining a sequence changing 
point that is the closest in the past from this time in said script implementing step; and 

the reproduction of said data is skipped to said sequence changing point 
determined closest past in said script implementing step. 

59. The multimedia data processing program according to claim 44 or 45, 
wherein the start portion or the end portion of the changed section of said data is added 
to a predetermined portion of said data in the case where an operation of said data 
change is carried out. 

60. (Cancelled) 

61 . A data structure for multimedia contents data, which is processed in a data 
processing device that includes a reproducing unit for reproducing media data and an 
inputting unit for receiving an input operation from a user, and which includes: 
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a reproduction describing unit for showing media data that is reproduced in said 
reproducing unit of said data processing device; 

an input operation describing unit for showing an input operation that is received 
by said inputting unit of said data processing device and a process that corresponds to 
said input operation; and 

a schedule describing unit for managing time of effect of said media data that is 
reproduced in said reproducing unit of said data processing device and time of effect of 
said input operation that is received by said input unit, wherein 

said multimedia contents data is processed so that predetermined media data is 
reproduced in said reproducing unit of said data processing device at a predetermined 
time on the basis of said schedule describing unit, a predetermined input operation is 
received by said inputting unit of said data processing device at said predetermined time, 
and said data processing device carries out a process that corresponds to said 
predetermined input operation at said predetermined time on the basis of said input 
operation describing unit. 

62. (Amended) The data structure of multimedia contents data according to 
claim 6L wherein said process that corresponds to said input operation received by said 
input unit of said data processing device is a process for adding a change to said 
multimedia contents data. 

63 . The data structure of multimedia contents data according to claim 62, 
wherein said process for adding said change to said multimedia contents data is a 
process for replacing a portion of said multimedia contents data. 

64. The data structure of multimedia contents data according to claim 62, 
wherein said change process for adding said change to said multimedia contents data is a 
process of adding data that is obtained by replacing a portion of said multimedia 
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contents data to said contents data. 

65. The data structure of multimedia contents data according to claim 62, 
wherein said process for adding said change to said multimedia contents data is a 

5 process for adding data that is obtained by replacing a portion of said multimedia 

contents data in a predetermined subsequent process to said multimedia contents data. 

66. (Amended) The data structure of multimedia contents data according to 
claim 61, wherein said multimedia contents data is data that is described in script 

10 language. 
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